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ABSTRACT 

This paper presents an analysis of a California state 
mandated effort to reduce dropout rates. In particular, the analysis 
looks at which program components and strategies are successful in 
increasing school holding power and what organizational and 
administrative factors are linkea to the decision to actually 
implement the program as designed. Section I of the analysis 
describes the legislated program and its outcomes, including 
assessment of the value of specific techniques (such as early 
identification of at-risk students, the value of parent involvement, 
and career training programs). After brief discussions of program 
components (an outreach consultant, student study teams as a dropout 
prevention methodology, school site councils in dropout prevention, 
and school~based coordination) in section I, section II explores the 
issues by examining linkages between specific program components or 
techniques and improvement in overall school holding power. Linkages 
are also examined for specific gender and ethnic target groups and 
the impact of the program on lower grades. Section III moves to 
mapping the program context, and examines the link between adoption 
or emphasis of the state program, elements and roles played by three 
major institutional actors (the outreach consultant or program 
coordinator, the school principal^ and the relevant oversight units 
of the California State Department or Education). Included are 15 
tables and A figures. (JB) 
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Passed in 1985, the Motivation and Maintenance (M&M) component of California's Senate Bill 
65 (SB 65) contained a number of innovations drawn from both field experience and from research 
literature on improving school holding power. In principle, its major program elements included reforms 
such as school-based coordination of program resources, a quasi-case management approach to dropout 
prevention, involvement of parent and community resources in the school planning process, and the 
creation of a new, community-oriented position—that of outreach consultant—whose role was intended to 
provide an alternative connection between the high-risk student and the traditional school hierarchy. 
Despite their relative familiarity conceptually, effectiveness of these programs elements has had only 
limited empirical validation. Equally importantly, since implementation of these elements represents 
major changes in the way in which many schools operate, there is little information on what 
organizational preconditions are required for such reforms to be adopted and effectively implemented. 

This paper examines two inter-related, but typically unconnected questions: 1) what program 
components and strategies appear to be successful in increasing school holding power, and 2) what 
organizational and administrative factors appear linked to the decision to actually implement the program 
as designed. Examples of the first question include assessments of the value of specific techniques, 
including the utility of early identification of at-risk students, the value of parent involvement, career 
training programs and the like. Of equal importance, is the impact of program support and emphasis by 
schools for each of the program's major elements: outreach consultant, student study teams, school 
planning processes, school based coordination and in-service training of staff. Building from a brief 
program background. Section II of the paper explores this question by examining linkages between specific 
program components or techniques and improvements in overall school holding power. Linkages are also 
examined for specific gendt-v and ethnic target groups, and the impact of the program on lower grades. 
Section III moves "backward" in its mapping of program context, and examines the linkage between 
adoption or emphasis of SB 65 program elements and roles played !iy three major institutional actors; the 
outreach consultant (or program coordinator), the school principal, and the relevant oversight units of the 
California State Department of Education. 



Section I: Background & Outame 



Pfogranimatically, the SB 65 Motivation and Maintenance program is a relative rarity in public 
policy, representing an attempt to implement, on a pilot basis, a number of experimental school holding 
techniques. A 1991 legislatively mandated analysis of the program ' found many of those techniques to 



' Dixon, Donald A, C. Jones & S. Brian btiplenicnthig Innava/ion: Effectiveness of SB 65 Motivation 
c6 Maintenance Programs in Ifuproving School Perfonnance & Holding Power, December, 1991, SRA 
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be relatively successful in improving school holding posver. While alone SB 65 does not solve the 
dropout problem, where the program has been implemented dropout and graduation rates have been 
significantly improved. While dropout rates differ greatly by ethnic and gender group, high schools 
which implemented these elements were able to decrease their overall dropout rate during the 1986 to 1991 
period Elementary and middle schools appear to have improved their third- and eighth-grade CAP 
scores Yet, not ev'ery participating school was successful. Despite successes for a majority of schools 
during the first two years, only 44 percent of SB 65 M&M high schools have been able to continue their 
improvement during the first five years of program operation. The key to the difference between success 
and failure appears to be the level of district support, and commitment and ability to undertake the 
sometimes fundamental change envisioned by the program. 

In its desi.'n the SB 65 program anticipated the consensus which appears to be developing in 
recent research and practitioner literature on those factors influencing a student's decision to leave 
school.- Beyond obvious problems related to social backgrouna and economic status, students are 
profoundly affected by 'school culture" considerations; including pohcies, informal norms, formal school 
structure and attitudes of teachers and st.-vff. As many students are probably "pushed out" of school as 
dropout; 'a fact officially denied, but consistently conf.rmed in both research literature and m our 
conv^rs^.tions and surveys of principals, teachers, program administrators, and outreach consultants. 

From this perspective, the most critical part of SB 65 was an attempt to address school culture 
considerations through creation of the new outreach consultant position. As envisioned, the need was to 
create an "advocate" position for at-risk youth within the school hierarchy; creating a sort of "pressure 
group" within the school culture. Whether implicitly or explicitly, the outreach consultant was seen as 
a way of articulating the needs of high-risk students in a bureaucratic and organizational setting; one which 
historically has focused more routinely on higher achieving groups. The position of outreach consultant, 
while not changing this situation structurally, was designed to become the "squeaky wheel" constantly 
redrawing attention of both teachers and administrators to the at-risk population. 

Other key aspects of the Motivation and Maintenance portion of SB 65 legislation built from this 
attempt to refocus attention of school site personnel on the needs of high-risk students. Tne requirement 
that SB 65 M&M schools become involved in a community-based planning process, implement Student 
Study Teams, institute school-based coordination of categorical funds, develop community resources, and 
initiate in-service staff training programs on high-risk yo ith were all attempts to refocus school attention 
and effort .oward meeting the special needs of at-risk students and thereby increasing school holding 
power. Significant linkages were found between program success and the degree to which all these 
elements were implemented. Schools which implemented these program elements were successful; those 
that failed to do so were not. 

TIic Outreach Coiisiiliuiii 

There is ample evidence that where integrated into a school's administrative culture, the outreach 
consultant position has a significant impact on improving school holding power. Possibly due to size, 
elementary and middle schools appear to have been more successful at achieving integration of the 
outreach consultant into their professional staff. At these school levels, the outreach consultant makes a 



- For example see, LeCompte, M.D. and A.G. Dworkin, Giving Up on Sclwol: Student Dropouts 
and Teaches Burnouts, Convin Press, 1991, Smey-Richman, B., School Clinmte and Restructuring for 
Low-Achieving Students, ResKirch For Better Schools, Philadelphia, PA (1991) or Dale Mann, "Can We 
Help Dropouts? Thinking about the Undoable" and Natriello, Pallas and McDill, "Taking Stock: Renewing 
our Re.search Agenda on the Causes and Consequences of Dropping Out", both in Natriello (Ed.) School 
Dropouts: Patterns and Policies Teachers College Press, NY (1986). 
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major contribution to providing ser\'ices to at-risk students. At the secondary level, there is both less 
understanding and conunitment to the function of the outreach consultant as a niechaijism to increase 
school holding power. While secondary prin(,ipals report that outreach consultant services are effectivs^, 
there appears to be conflict and lack of support for the position from counseling and guidance personnel. 
Principals are not sufficiently clear about the function and job description of the outreach consultant to 
dampen this conflict. 

Further integration of outreach consultants into the school culture depends upon both greater role 
clarity by principals regarding the outreach consultant, and better familiarity of the outreach consultant 
with the overall goals, methods, and objectives of SB 65. Given relatively rapid turn-over of principals 
and (more recently) outreach consultants at SB 65 schools this clarity is difficult to ensure. 

Student Study Teams as A Dropout Prevention Methodology 

This case- management approach offers the greatest possibilities in increasing school holding 
power, but is unlikely to be implemented fully. While there is little doubt that the Student Study Team 
(SST) process works and is extremely effective in assisting at-risk students, the process is extremely 
resource intensive and because of this serves relatively few students. Proper use of the Student Study 
Team requires participation of the outreach consultant, parents, guidance and counseling personnel, 
teachers, and other service providers. The average school holds approximately three SST meetings each 
week, typically before or after regularly scheduled school activities. There is great variation between 
schools in terms of their understanding, use and commitment to the SST methodology. 

TJie Role of School Site Councils in Dropout Prevention 

An unexpected finding in this study was the relationship between program success and the value 
placed upon the school site co incil planning process. In those schools where outreach consultants and 
principals reported high levels of acceptance and interaction with the School Site Council, improvement 
in school performance was generally evident. This improvement was true of both the California 
Assessment Program (CAP) score and dropout improvement rate. 

Since School Site Councils are not involved in providing direct services, what was measured here 
was the impact of a school climate which placed a high value on community advice and opened school 
decision -making to parents, staff and members of the community. Schools which have a more "open" 
decision process are apparently better able to rej^pond to specific demands of at-risk students. It is 
possible to speculate that, as with successful integration of the outreach consultant into the school's 
hierarchy, active participation in school decision-making by School Site Council members served to 
sensitize the school culture to the needs of the high-risk population and to shift them higher on the schooPs 
scale of internal priorities. 

School-Based Coord in at io n 

School-based coordination appears to be the least understood and the most resisted element of the 
SB 65 program. Until 1991, the Department was unclear whether school-based coordination was a 
mandatory or permissive portion of the SB 65 legislation. At both the district and school level, there is 
almost total lack of clarity regarding this concept, its intent, or methods of implementation. Based upon 
the experience of years of prohibition about mixing funds and upon the cost of combatting the outright 
opposition from those controlling various types of programs, site and district administrators were often 
unwilling to use resources in a way ie4 aired by a school -based approach. 

Given evidence linking school-based coordination with improved s.iiool performance, and given 
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Table II. 1 

the increasing interest in integration of 
school, health, and social services prog- 
rams, there remains a clear rationale to 
increase school-based coordination to a 
meaningful level. 

Section II - Implementation & 
Outcome; Elements of SB 65 That 
Work 

Two strategies were followed in 
examining linkages between program 
elements and successful outcome. The 
simplest method was to examine differences 
between high-and low-performing schools. 
Schools considered high-performing in this 
part of the analysis were the top one-third 
of the sample of both SB 65 and comparison 
schools in terms of dropout rate reduction.^ 
By examining differences in priorities, 
program content, and attitude among high- 
and low-performing schools, patterns of 
implementation can be linked to successful 
and unsuccessful outcome. A second 
method examines the same relationships 
using associative techniques for ail SB 65 
schools. While a correlative rather than a 
causal model, this part of the analysis examines the extent to which a single factor, such as degree of 
outreach consultant integration into the school culture or level of support by the principal, is associated 
with program success.^ While not conclusive, the results of both methods of analysis suggest strongly 
that where fully implemented, many elements of SB 65 are linked to dropout reduction and improvement 
in achievement test scores. 

There are, of course, important limitations to correlative findings. While study results suggest 
an important set of relationships, it is not claimed that SB 65 program elements exclusively "caused" such 
improvements. It is hard, for example, to know whether a factor such as support for the outreach 
consultant, which seems closely linked to program success among female students, is not part of larger 
school climate considerations. Schools which show high levels of support for the outreach consultant 
generally have succeeded in decreasing dropout rates. What is uncertain is whether this support enabled 



^ While the comparison group of 200 low performing, non-SB 65 schools is not included in the 
analysis which follows, they were used in ranking schools into "high," "average," and "low" performing 
groups. The meiisure used was changes in the three-year cohort dropout rate. The means for the groups 
are as follows: High Performing: SB 65 schools -10.8 Comparison -10.7. Average: SB 65 schools -2.9 
Comparison -3.1 Poor: SB 65 school +5.6 Comparison +6.3. There is no statistical difference between 
the means of SB 65 and Comparison schools within each performance group. 

^ Unless noted, association values are based upon a Pearson's r correlation coefficient or, for 
categorical data» a KendalTs TaU"/;/c\ Unless otherwise specified, significance is accepted at the .01 level. 
Student's t wiS used to assess differences between high- and low-performing schools. Given the relatively 
small number of cases, significance of / is accepted at the 90 percent level of confidence. 



Program Factors Linked To Decrease 
in 3-Year Cohort Dropout Rate 
(Correlation Cocfficicms) 





Cohort 


Cohort 


Cohort 




Both 


Male 


Female 


Congruence 


.32 


.27 


.29 


Dislricl Support 


.23 






School Stability 


.22 


.25 




Importance SSC to Principal 


,21 


,23 




Number of SSTs 


,21 


,19 


,21 


Coniiuiinient to OC 


,19 




,22 



Significant Program Priority Differences 
In High and Lx)w-Performing Schools 

School Performance 

High Low Significance 
Prograiu Factors* (2-Tailcd) 



OC's Commitment SB65 


4,0 


3.1 


.04 


Congruence 


3,4 


2,0 


,05 


Integration, of OC 


3.8 


3.2 


.07 


Overall Support 


4,3 


3.7 


.08 


Support for OC 


4.2 


3.3 


.09 



♦Note: Mean scores on a I to 5 scale (I =low 5 = high). 
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the outreach consultant to "cause" the change, or whether the support itself c^- ^ated from an overall 
school commitment to institute such changes. School cultures and the inte.^iction among program, 
administrative structure, and individuals, both staff and students, are too complex to allow certainty. It 
is significant, to continue the example, that in schools where performance failed to improve, support of 
the outreach consultant was not evident. 

Table 11.2 

Linka^^es Between SB 65 Program ,^ggggt^a^^,^^aiaamammHmmi^^^mm^^^^^^^^m^mM 

Coinponent.s and Changes in Hlj»Ii 
School Dropout Rates 



Difference in Emphasis of Program 

Techniques and Strategies 
in High- and Low-Performing Schools 

(Mean score* of re«f>onBC*) 
School 



Slratcgics and Techniques High 

Outreach consultant 4.5 

Early idenlificalion 4.5 

Career awareness and preparation 4.1 

In-service training 3.8 

Parent involvenienl 3.7 



Performance 
Low Significance 



3.6 

3.4 
3.2 
3.1 
3.0 



.03 
.01 
.01 
.06 
.08 



Change in the three-year 
cohort dropout rate is most closely 
associated to five factors: the 
congruence level between the outre^ich 
consultant's ideal program and the one 
which has actually been implemented; 
levels of district support for the 
program; the importance placed by the 
principal on the School Site Cou icil 
planning process; stability of the sciiool 
administrative structure; and overall 
commitment by the outreach consultant 
to the SB 65 program. 

When differences in SB 65 
implementation between high- and low- 
performing schools are assessed, 
schools which significantly decreased 
their overall dropout rate had an 
outreach consultant with a strong 
commitment; high levels of congruence 
between the outreach consultant's view 
of effective program strategies and ^m^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 
those which they have been allowed to 

implement; a program which successfully integrated the outreach consultant into the school culture; and 
a high level of overall support for the program by the principal and others. In addition, the level of 
personal support perceived by the outreach consultant was significantly higher in high-performing schools. 

Beyond such general factors as levels of community resources or degree of integration of the 
outreach consultant into the school culture, assessment was also made of the effectiveness of a variety of 
program components and techniques and their linkage to overall program outcome. Principals were asked 
to assess the importance of each of these elements in dealing with at-risk students. While not a direct 
measure of the degree of implementation, the principals' assessment constitutes an indication of priorities 
at a specific school. 

Among programs which were emphasized as important by successful schools were the outreach 
consultant program itself, early identification of high-risk students, career awareness and preparation 
programs, in-service training by outreach consultants of other staff personnel, and parental involvement. 
Principals in schools which had greater success in decreasing dropout rates were significantly more likely 
to emphasize these strategies as effective, in contrast to schools where there was little or no improvement. 

Alternatively, if associations between program strategy and overall performance for all schools 



'Noic: .Si£niri«iKC of ihtf diffcretKX between (Ik mean «<"orcA of Ut two group* « (wo-uilcd. 
EZxnphuu iCi'x u bused on principals' a&^cssmcnt of iinporuiKc tnd cfTcdivcrtcM of vanout 
fa^.ofs in dealing vkiih »t-rtsk stuicnla (5 is • very hi^h emphwi*. 3 » iverafie, and 1 u very 
lew.). 

Strategies and Techniques Linked to Decrease 
in Three-Year Cohort Dropout Rate 

Corrclaiions 

In-service Training .33 

Career awareness & preparation .3 1 

Early idcmificalion .27 

Parent involvement .26 

Number of SST's .23 

Outreach consultant .23 

Number served .19 
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are examined, rather than the difference 
between high- and low-performinii 
schools, the picture which emerges is 
similar, although two additional factors 
are significant: the frequency with 
which the SST process was used and the 
number of students actually served by 
the SB 65 outreach consultant. As these 
factors increased, dropout rates 
decreased. Emphasis on all seven 
strategies, however, appears linked to 
improvement in dropout scores. In 
order of importance, these were: in- 
service training of school staff on 
dropout prevention and recovery (.33); 
development of alternative career and 
work experience 



Importance SSC lo principal 3.7 
Overall support SB 65 4.3 
School slabilily 4.2 
Effcclivcncss of supcrinlendenl 



Program Factors* 




Council principal 
Sch(X)l slabilily 



Overall support SB 65 



Importance School Siic 



Program Factors Linked to Increase 
in rZlh-Grade Reading Scores 
(All Schools) 



Difference in iVogrum Fuclors 
High- wkI IxjW'Pcrfonnlng Schools 



School Performance 
High Low 



Correlations 
.44 



3.0 
3.7 
3.1 



.35 
.32 
.29 



Significance 
(2-Tailcd) 



.01 
.04 
.07 



programs (.31); early identification of 
potential dropouts (.27); parental 
involvement (.26); number of SST 
meetings actually held (.23); principaFs 
emphasis on outreach consultant 
program (.23); and the number of 



♦Note: Mean scores on a 1 to 5 scale (I=Iow 5 = high). 



in gelling SB 65 resources 4.2 
Disiricl support SB 65 3.9 
Importance of SSC lo OC 3.0 



3.7 
3.5 
2.4 



.07 
.08 
.09 



Students actually served by the SB 65 

program (.19). The emphasis by mm^^^^mam^^^^^^^^^^^^^^^^^^^^^ 

principals on Alternative Education and 

Work Center (AEWC) programs as a successful dropout prevention strategy parallels findings in the SRA 
Associates' Against All Odds study (1990) of the portion of the SB 65 program dealing with AEWC and 
Educational Clinic programs. 

Strategies which were not considered effective at high-performance schools, and which showed 
no siatistical relation to improving dropout rates across all schools, included parent training, private-su:tor 
partnerships, attendance incentives, promotion with special assistance, or an articulated transition program. 
Several of these strategies were linkeJ with positive results among students from specific ethnic or gender 
groups. 

Linkaj;es Between Program Stratej^ies and Chanj»es in 12th-Grade Reading Scores 

Implementation levels and the priority assigned to SB 65 program components were also linked 
lo improvements in twelfth-grade standardized residing scores, although the pattern of importance differs 
slightly from those linked to dropout reduction. Program factors linked to improvements in reading scores 
include the principal's emphasis on school-based coordination (.44), the importance placed by the principal 
on the School Site Council planning process (.35), school stability (.32) and overall support for the SB 
65 program (.29). 

Analysis of the difference between low- and high-performing schools reveals several additional 
linkages between the program and reading score improvements. In addition to the principal's assessment 
of the importance of the School Site Council planning process, support for SB 65 and school stability, an 
additional factor associated with high-performance schools was the outreach consultant's view of overall 
effective support of the SB 65 program. Among high-performance schools, the outreach consultant was 
significantly more likely to see the program as effective; in low-performance schools, assessment of 
overall program effectiveness and support for the program was lower. 
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Specific techniques which 
appear associated with reading score 
improvement include the schooPs 
emphasis on parental involvement (.35); 
in-service training of staff in ^ow to 
work with high-risk students (.27); 
establishment of a school-within-a- 
school (.26); development of an 
articulated transition program (.24); 
career awareness and preparation 
programs (.24); private-sector 
partnerships (.22); attendance 
monitoring (.22); and early 
identification of high-risk students 
(.21). With the exception of parental 
inv^olvement (.40), changes in average 
math scores are not linked to any 
particular technique or program 
component. Math score change was 
linked to specific program elements 
within various ethnic groups. 



Techniques and Strategies Linked to Increases 
in. I2th-Grade CAP Reading Scores 



StriJtt*;'.ics and Ti-chniqiies 


Correlation 


Parental involvcnicnl 


.35 


In-scrvicc training 


.27 


School-Wiiliin-A-School 


.26 


Ailiculatcd transition program 


,24 


Career awareness and proparittiuii 


.24 


Private'sector partnerships 


22 


Attend monitoring 


.22 


Fiarly identification 


.21 



Emphasis of Techniques and Strategies 
in High- and Low-Perfonning Schools 



Performance 


Significance 


High 


Low 


(2-Tailed) 


Twhniqii(,»s and Stnitt^^ies* 






Parent involvement 3.7 


3,0 


.09 


Early identification 4.2 


3,5 


.09 


*Note: Mean scores on a 1 to 5 scale 


(1 =low 


5=high). 



Important differences in 
strategi-^*-' between high- and low- 

performi.ig schools included differences in the values assigned to parent involvement and early 
identification of at-risk youth. In higher-performing schools, these strategies or techniques were more 
likely to receive greater emphasis from the school principal. 



Linkages Between Proj^ram Stratej^ies and Changes in Overall Grttduation Rates 

Linked to changes in dropout levels, the rate of graduation is also affected strongly by students' 
academic performance. Remaining in school for four years, while reducing the dropout rate, is not in 
itself sufficient to graduate. Changes in graduation and dropout rates, while significantly correlated (- 
.22), are not identical. Among both program and comparison schools, as dropout rates fall, graduation 
rates move upward; there is not, however, a one-to-one correspondence. 

As might be expected, therefore, relatively fewer of SB 65 program components and strategies 
relate to ini[)i ovemcnt in graduation rate. While not strictly part of this evaluation, a brief description of 
these relationsiiips is included here for purposes of completeness. 

Suq-^risingly, factors which appear most closely linked between program component and 
improving graduation rate measures include the assessment by both the principal (.32) and the outreach 
consultant (.30) of the importance of the School Site Council in the school planning process. As 
assessments of importance increased, graduation rates increased. Since the Site Council is not involved 
in providing direct services, this measure probably assesses the extent to which the school is attempting 
to implement a consultive planning model, and hence is at least partially a measure of responsiveness to 
community needs. Confirmation of the importance of these factors is also found in assessing differences 
between high- and low-performing schools. In high-performing schools there is greater importance 
attached to the Site Council process by both princip..! and the staff. In addition, a relationship exists 
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between congruence of I he outreach 
consultant's view of effective program 
strategies and those which they have been 
allowed to implement. Where the SB 65 
outreach consultant sees a match between 
ideal and actual strategies, the school is 
more likely to be in the higher-performing 
category. 

Specific techniques which appear 
associated with improvement in graduation 
rates include only two: the emphasis placed 
by the principal on the SB 65 outreach 
consultant, and the importance attached by 
these two to in-service training on high-risk 



Table 11.5 



Significant Program Priority Differences 
in High- and Low-Performing Schools 



School Pcrforninnoc Significancu 

iiiph Uw (2«Tailed) 

Program Factors* 

Imponancc SSC School 3.4 2.6 .02 

Iniponancc SSC lo Principnl 3.H 3.0 .07 

Conijaicnco 3.7 2.5 .09 



Strategies and Techniques Linked to 
Increases in Graduation Rates 

Corrclalions 
Outreach Consuliani .28 
In-service Training .27 

*Nolc: Mean scores on a 1 to 5 scale (1 =low 5 = high). 



youth. 

Ethic and Grade-Level DilTerenccs in 
Dropout Rate Improvement 

Viewed from the aggregate level, ■H^^^^^^^^^^MH^^HHaaM^^HWMMnMi^H 

schools which improved their tenth grade 

dropout rates were also able to improve rates in the eleventh and twelfth grade. Our previous research, 
however, has emphasized that even in the same school, dropout rates vary widely by ethnic and gender 
group. Fluctuations in dropout rates follow a similar pattern: changes in the female hispanic tenth-grade 
rate are correlated only weakly with changes in the eleventh-grade rate, or with the rates for males, or 
for other ethnic groups. As might be expected, therefore, while there is a great deal of overlap, the list 
of factors which are associated with program success vary by gender and ethnic group, and by grade 
level.-' 



Linkages Between Program Stratejj;ies and Changes in School CAP Scores 

Since dropout statistics are not yet kept for students below the tenth grade level, one of the few 
common measures of program performance across schools are changes in CAP scores. SB 65 high 
schools were chosen for their high dropout and low socio-economic levels. ITiey are also schools which 
have CAP scores well below the state averages on both reading and math. In California, at the high 
school level, there is a relatively high relationship between CAP score and dropout rate; as dropout rates 
increase, CAP reading scores generally decrease. Among SB 65 and comparison schools, the relationship 
i •: e\ en stronger than statewide; especially when rates of change are examined. At a statistically significant 
and relatively strong level of association (-.30), schools which have decreiising dropout rates typically have 



^ While space limitations prevent discussion here, it should be added that different ethnic groups 
exhibit even greater differences in the patterns of linkage between dropout rate reduction and program 
components and strategies. Complete discussion of these differential impacts is found in Dixon, et'al 
Itfipicfficniifig Itinovdfion, SRA A^-sociates, Sebastopol, CA 1991. (Also available from the School 
Interventions Unit, California Stale Department of Education, 1992). 
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improved their CAP reading scores/ 



Middle and elementary schools that participated in the SB 65 program arc also low i^ocio- 
economic sc1kh)Is with typically low reading and math scores. While no dropout data on these schools 
exisl» the relationship at the high school luvel between improving school CAP scores and improvement 
in dropout rate suggests an that an examination of CAP score change would provide a possible measure 
of the success of SB 65 programs at tl'.e elementary and middle school level. The section below, 
therefore, examines linkages between SB 65 program components and strategies discuSvSed e^irlier and 
changes in school CAP score performance. • 

Linkni^es Between Program Strategies and Cluuis^es in Stii Grade CAP Seores 



Highlh-grade students in M&M schools Table H.6 
performed quite well, increasing their average 
residing score by over ten points and their math 
score by more than fourteen points. 
Implenientation of the various components of SB 
65 programs were related to the increases in the 
CAP reading and math scores. The importance of 
two of the critical components of an MSiM pro- 
gram, the Student Study Team and the School Site 
Council, were highly correlated to improvements 
in both math and reading scores. A third major 
component, school -based coordination, correlated 
with improvements in both reiiding and math 
scores, but the relationship was not quite as 

strong. Those schools that placed a high value on these elements of program design, performed better 
than those that did not. The perceived effectiveness of the fourth major component, outreach consultants, 
distinguished the high-performi'ig schools from low-performing schools. While most principals found that 
their outreach consultants were effective, those from the highest performing schools were nearly universal 
in assessing the effectiveness of the outreach consultant at the highest possible level. 

Middle schools that set clear goals and priorities, communicated them effectively, and fully 
integrated elements of the SB 65 program into their school culture, also showed more of an improvement 
in their CAP scores. Schools which were judged to provide overall support for the program both at the 
school site and from the district also increased their CAP scores more than those that did not. 



Techniques and Strategies 




Linked to Increases 




in 8ih Grade CAP Reading Scores 




Cotreiaiions 




S(r;\tegies aJid Teclmicjues 




School-within-a-School 




Care-er awareness and preparation 


n 


Systematic attendance monitoring 


21 



At the schools where average CAP scores improved the most, support from the State Department 
of Education wi:s judged less harshly than s«rhools where average performance did not improve. Either 
this is because the schools actually received more support and assistance from the Department or because 
the better performing schools felt that they did not require a greater level of help from the Slate 
Department of Education. 

High performing schools on the math test also were more stable and lived in an environment of 
less political conflict between the school board, superintendent, and the community than did low per- 
forming schools. An atmosphere of political conflict and turmoil can be quite upsetting and interfere with 
teaching and consequently, learning at the school site. 



^' This linkage is even stronger between overall changes in reading and dropout score improvements. 
The assoi^»ation between increasing CAP reading scores and decreasing three-year cohort rates for both 
male and female While students is -.36; for female Afro-Americans its -.35 and female Asians it is -.34. 

Section 11: Implementation & Outcome - Kli'ments of SU 65 That Work 9 



10 



The oulrciich consullanls at lliosc Tnhle II. 7 
schools with the most improvement in their 
maih scores were cjuite involved with a 
variety of policy-making activities at the 
school. They were well integrated into the 
school environment and yiven a»aliori:y to 
exhibit some influence in their areas of 
expertise. 

CAP scores showed the most 
improvement at the middle school level, and 
those schools which were the most successful 
on these tests had the most fully integrated 
SB 65 proiiram. They appear to have fully 
implemented the various components of the 
program and, at least the school principals 
judge these components as effective and 
important. 

Only three specific technicjucs and 
strategies are correlated to change in eighth- 
grade reading scores, and these cor r-ilat ions 
are not as iiigh as those found for the pro- 
gram components. The strategy with the 
highest corporation (.26) is the establishment 
of a sohool-'.vithin-a-school, a strategy which is seen by many as Increasingly appropriate for the middle 
school students. The other two lechnitjucs are career awareness and preparation programs and systematic 
attendance monitoring. No techniques or strategies distinguished the high performing schools from the 
low performing schools. 

The list of strategies and techniques ci^rrelatcd with changes in math scores, however, is longer 
and the relationships are stronger. Both systematic attendance monitoring and attendance incentives are 
related to miprovement in math scores for eighth-graders and these also distinguish between the high- 
performing and low-performing schools on the math test results. Tliose schools which place mor^ 
emphasis on these attendance measures are doing better than those which do not. Those schools judging 
these strategies as effective are most likely more efficient at getting their students to come to school where 
they are able to gain the knowledge necessary to do better in math. 

The establishment of a school-within-a-school distinguishes between the high- and low-performing 
schools on math as docs providing staff in-service training on at-risk youth and encouraging promotion 
with special assistance. The Student Study Teiims are judged to be more effective at those schools which 
have improved their math scores the most than those which were low-performers on this measure. 

Overall, using improvement in CAP scores, those M&M programs at middle schools which took 
their grant from the state and fully integrated the components of the program and established effective 
attendance monitoring and incentive programs have shown the most improvement in both reading and math 
scores. 

Littkages Befnren Prof^ratn Srraregics and Clian^cs in 6th Grade CAP Scores 

The sixth grade presents a very different picture than the eighth grade. On the average sixth- 
grade CAP scores changed very little. Some sixth grades a. ^ found in elementary schools with third-grad- 

Stclioii 11: Iiupltuieutatioa & Outcome - ICleiuenl^ of SB 65 Tliat Work 10 

11 



Techniques and Strategies 
Linked to Increases 
in 8th Grade CAP Math Scores 



Stratt'j»ics and Techiiiciues 

SysJoinalic aHoiulanco ni<Miil'.>i in^^ .30 

Aucnuanco iitccnilvcs .29 

Sclioo) wiihin a school .27 

Dirly idontinoailon of a'-risk vouih .26 

Siafrin-scrvico on high-risk youlh .23 



DilTcrcucc in Kmpha.sis of 
Techniques and Sirnlcgics 
High- and Low> Performing Schools 

School Performance 



Sira(ej»ics and Techniques 


High 


Low 


AsuinlaiKO moniloring 


4.5 


3.6 


Promoiion wiih special assi.stanoo 


4.5 


3,3 


Saidonl 5ludy leams 


4.2 


3.6 


Schnol wiihin e school 


4.2 


3.0 


In-seiNice on ai-risk yoiiih 


4.2 


:.i 


Auendance inceniivcs 


4.2 


3.1 



Tabic II.8 

ers, some arc in middle schools alon^* with 
(he eighth grade, and a few are in schools 
with neither. ' Many more Mc!<:M schools had 
decreasing sixth-grade scores than had 
decreasing eighth-grade scores. Because the 
sixth grade is often linked with other grades 
that may be showing CAP score improve- 
ment, principals and outreiich consultants 
were likely thinking of other measures wlien 
they were judging the effectiveness of tlieir 
programs. The only program factor 
correlated to a change in six ill -grade CAP 
scores is the number of students served by 
the outreach consultant, However, this is not 
actually a program factor since i( can be 
influenced by the size of the school. The 
more legitimately related program factors such as the effectiveness or importance of the SST process are 
not related to changes in sixth-grade reading or math scores. 

District support for the program is Table II. 9 
weakly (.18) correlated to changes in the 
reading score. The one strategy that 
distinguishes high- and low-performing 
schools in the sixth grade is the effectiveness 
of private sector partnerships. This 
technique is not related to impiovenient in 
scores in either the third or eighth grades. 

Several strategies apfiear to be 
backfiring when looking at ^ixth grade 
scores. Systematic attendance monitoring is 
negatively correlated to improvements in 
these >:c()res. in other words, those schools 
which have judged themselves having the 
most elTective attendance programs are 
showing the least improvement in their CAP 
scores. Also the schools which have the 
most SST meetings per month are showing 
less improvement on their math scores than 
those which have fewer meetings. This may be indicative of a link between low-achieving students and 
the number of SST meeting held at the school site. 

The last, and unfortunately highest correlation (-.31), on changes in sixth-grade math scores is 
the measure of congruence between what the outreach consultant sees as the ideal program and his or her 
assessment of the current emphasis on various components of the program. At the sixth-grade level, 
programs which are judged to be further from the ideal are performing better than those where the 
outreach consultant sees a match between the ideal and actual strategies. Again, this may be reflective 
of the respondents not considering sixth-grade student academic achievement when assessing the program. 

Link(i\;cs Between Proi^rain Siraie^ies and Changes in 3rd Grade CAP Scores 

I'or the third grade, KccM schools had mixed results in CAP score changes; average reading 



Program F-aclors, Slratcgics, and Techniques 
Linked lo Increase in Clli Grade Reading Scores 



Nuniborof SSTcnscs .29 

CaiVvM' uwaroness aiul proparalion .2.*) 

Dislrici support . 1 8 

SyMoinalic aUoiulance inonilorinij -.28 



Bniphasis of F^ro^Tuin Factors 
and L*w-Perforining Schools 

School Per forma I1C0 
Hlyh Low 

Private socioj- p.'iiincrshi|>> 4.0 3,1 



Prograi ^ Factors Linked to Increase 
in 6th Grade Math Scores 



Private sector partnor.^hips .20 
Nunit)cr .served by the 

Outreach Consultant .17 

SyMeniatie attendance monitorin^^ -.17 

Nuinbor of SST per month -.19 

Consilience -.31 



tmphasis of Program l-aclon^ 
High- and Low-Pcrfonning Schools 

School Performance 
Hijih Low 

Private sector pailnerships 4.0 3.1 
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Table 11.10 



Program Factors Linked to Increase 
in 3rd Grade Reading Scores 



scores went down wliile average math scores 
moved upward by a small amount. Several 
program strateiiies correlated, although not 
very highly, to improvement in reading 
scores. These included the principal's 
assessment of the effectiveness of an 
articulated transition program, attendance 
incentives, and the early identification of at- 
risk youth. 



One element of full M&M 
implementation negatively correlated to 
reading score improvement. Outreach ^^^m^^^m^^^^^^^^^^^^^^^^m^^^^^^^^ 

consultants who were given more influence 

and say in policy-making at their schools tended to be at schools which fared less well on the reading 
tests. This is related to the fact that outreach consultants at the higher performing schools in third-grade 
reading had less education than those at schools that performed ^^orse on Ihis measure. 

Table ILll 



Program siralcj,'y effectiveness 


.37 


Articulaled transilion program 


.19 


Number of SST cases 


.18 


Aiiendancc ir.ccniives 


.16 


Eirly idenlificallon 


.15 


Influence of outreach consultant 




on school policy-making 


-.15 


Educational level of 




outreach consultant 


-.28 



The highest correlation to 
improvement in both reading and math scores 
was an composite index measuring effective 
dropout prevention strategies. This index 
correlated to the change in reading scores at 
.37 and to change in math scores at .34. 
This may be indicative of different strategies 
being effective in different school 
environments and also the variability in 
program implementation. 

The importance of the School Site 
Council and the effectiveness of parent 
advisory committees correlated to math score 
improvement. Schools which had an open 
planning and decision-making processes relat- 
ed to their programs showed a greater im- 
provement in math scores than those that did 
not. The higher performing schools in math 
believe in and use these committees at their 
schools. 



Program Factors Linked to Increase 
in 3rd Grade Math Scores 



Effecliveneiis of program strategies 


.34 


Importance of School Site Council 


.26 


Parent advisory coniniittsres 


.22 


Attendance incentives 


.16 


Number served by outreach consultant 


.16 


Eirly identifrcation of at-risk youth 


.15 


Educational level . f outreach consultant 


-.20 



Emphasis of Program Factors 
High- and Low-Performing Schools 



School Performance 
High Lx)w 



Parent advisory committees 



3.9 



3.4 



Attendance incentives and early identification of at-risk youth are two program strategies that 
correlate with math improvement as well as reading improvement in the third grade. Elementary schools, 
where the outreach consultant serves more students, also show a slightly better rate of improvement in 
math scores. 

Overall, since there are not a lot of high correlations between CAP score improvements and these 
measures oi' program implementation and integration at both the third- and sixth-grade levels, elementary 
school outreach consultants and principals were likely assessing much broader changes and impacts within 
their schools when answering questions related to the effectiveness of various SB 65 program elements, 
strategie . and techniques. 
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Seclion III: Linkages between School Environment & Successful Implementation 



Beyond the linkages between levels of implementation and school success, it is also necessary to 
examine the preconditions of implementation. Given a successful set of program components or reforms - 
- even allowing for differential success with differing ethnic and gender groups — what organizational 
preconditions were required for such reforms to be adopted and effectively implemented? 

In the case of our research on the SB 65 program, an attempt was made to move "backward" into 
the program context; to examine the linkage between adoption or emphasis of SB 65 program elements 
and roles played by three major institutional actors; the outreach consultant (or program coordinator), the 
school principal, and the relevant oversight units of the California State Department of Education. What 
is being argued is that, since implementation of various elements represent potentially major changes in 
the way in which many schools operate, it is necessary to explore the organizational and administrative 
factors which appear linked to the decision to actually implement the program as designed. In some sense 
our results were hardly surprising. Intuitively, programs which operate in supportive environments would 
seem more likely to be successful than those which must overcome administrative hostility or indifference. 
SB 65 programs were no different. The degree to which the SB 65 program was implemented (and hence 
successful) was highly related to levels of principal support and attention. Support for the outreach 
consultant by teachers and other administrators was also highly correlated. Equally interesting however, 
in the era of dissatisfaction with "top-down" programs and skepticism about the value of state-level 
oversight and technical support, schools which implemented the program as designed (and hence were 
successful in reducing dropout rate or improving CAP scores), had a higher levels of SB 65 related contact 
with staff at the Slate Department of Education. 

Outreach Coasultant: Support & Impact In the School Envirnonment 

Four general types of measures were considered in our examination of the programmatic 
enviionment of the SB 65 outreach consultant: 

measures assessing the relationship of the outreach consultant to their school culture, 
including perceptions of personal influence over the decision-making process and support 
from other school officials; 

measures examining outreach consultants* conunitment to the program and acceptance 
of the techniques and programs which were being utilized at their school; 

measures of outreach consultants* perceptions of two principal SB 65 program elements: 
Student Study Teiuns and school-based planning involving the School Site Council; 

measures of job alienation or "burnout." 

In both site visits and surveys of SB 65 program personnel we were struck by the strong linkages 
between job and organiziitional characteristics, outreach consultant attitude and commitment to the 
program. There was also a strong relationships between organizational factors and the outreach 
consultants* feelings of accomplishment and degree of job burnout. 

The degree of support given to the outreach consultant by principals, teachers, district officials, 
and other school personnel was strongly related to both commitment and the consultant*s sense of 
accomplishment. Statistically the correlation was extremely high (.78) between support and commitment. 
There was also a strong interrelation (.39) between support received and the amount of influence the 



ERIC 
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ommiimcnl 



outreach consi'ltam perceives on niakinj: 
educational and projzram decisions. This was 
unsurprising, since bo^h influence and support 
probably reflect the value a particular school 
places on the SB 65 proi^ram. The more the 
piogram was supported, the more influence the 
outreach consultant was likely to have within the 
decision-making process. Influence (.30) and 
support (.51) were also closely related to the 
degree of congmence between what the outreach 
consultant felt the program should do and what 
••^he was able to do. Both congruence (.44) and 
levels of influence (.43) were also slrongly 
related to overall commitment by the outreach 
consultant to the SB 65 program. Unsurprisingly, 

the greater the levels of support, influence, and congruence between the consultant's view of what the 
program should do and what s/he was allowed to do, the greater the levels of commitment.'^ 




Rclelion bciwccn school cnviixanmcnl, congruence with 
consulianl's it-eals, and overall commiimeni 



Fij^ure III-l 



These inter relations have two 
programmatic effects: they were closely related 
to the overall burnout level of the outreach 
consultant, and they affect the valuation and 
utilization of two of SB 65's major elements, the 
SST process and the School Site Councils. 




Commiimeni 



Emotional Exhausiion 



Influence-.^ 



Support 



+ .33 



Congruence 
Commiimeni 




Accomplishmenl 



+ .34 



Two measures of burnout were found to 
be especially relevant to the outreach consultant: 
emotional exhaustion and a sense of 
accomplishment. As might be obvious, the 
relationship (-.28) between these was negative— as 
emotional exhaustion rises, the consultant's sense 
of accomplishment typically diminishes. 
Emotional exhaustion^ — feeling at the end of 
the rope or constantly tired when thinking about 
work— has a very high negative correlation (-.55) 
with the level of support given to the consultant. 
If administrative support was forthcoming, then 
this measure of job bumout was heavily reduced. 
There was also a high correlation (-.42) between 
the congruence index and emotional exhaustion. 

It was difficult and frustrating for consultants to work in a program that does not emphasize the areas they 
feel Wv,re important. As the program changes to reflect more of their personal values, the levels of 
exhaustion diminish. Commitment was also closely related (-.41) to this aspect of bumout. The greater 
the commitment levels, the lower the chance that consultants will feel burned out by their activities. 



Relation bclwecn school envircnmcnl, congruence, 
commiimeni and emotional exhaustion and »ccomprishmcm 



Figure III-2 



^ Although these diagrains may resemble path analysis charts, these are graphic representations of 
Pearson's r correlations. Unless otherwise noted, all correlations reported are significant to the .01 level. 

^ As reported elsewhere, this section relies upon questionnaire items from the standard Maslach 
Bumout Inventory. See also Dixon, hnplementing Innovation, I99I. 
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The only school culture and program variable that was not correlated (o emotional .ixhaustion was 
the amount of perceived intluence the employee has over school policy. At least among this group of 
employees, the degree of control over policy matters was not related to feelings that one's job has become 
too frustrating or too arduous. 



The opposite of burnout was a sense 
of accomplishment. Overall, as indicated 
earlier, consultants typically had a high sense 
of accomplishment. Feelings of 
accomplishment, however, were linked to 
levels of support, congruence, influence, and 
commitment. Consultants who report high 
levels of support were likely (.33) to have a 
higher level of personal achievement. 
Similar patterns were found between 
perceived levels of influence (.33) and 
commitment (.34), and accomplishment 
levels. As influence and commitment 
increased, so too did the sense of 
accomplishment. Congruence between what 
the outreach consultant wanted and was 
allowed to do also were linked (.34) to a 
sense of accomplishment. The more the 
program matched the consultant's ideal, the 



Support 
Comniilnicni 
Influence 




Opinion/Use SSTs 




Involvement Wi Siie Council 



Relation between influence, commitmenL and support and 
acceptance of program components 



Figure 1II-3 

t^'^f""' ' 

greater the likehood of feeling that something of value was being accomplished. 

Levels of outreach consultant commitment, influence, and support also affected perceptions and 
utilization of two of SB 65's major elements, the SST process and the School Site Councils. A strong 
relationship (.51) exists between levels of outreach consultants' commitment and their utilization and 
evaluation of the SST process. The greater the level of commitment, the more likely they were to both 
value and use the SST process more often. Similar relationships were found between support (.50) and 
influence (.40). As administrative support increased, and the outreach consultant's influence in the school 
decision process grew, the use of the SST increased. Although at the core of SB 65 program design, 
SST's represent a difficult, time-consuming and resource-intensive methodology. It v/as hardly surprising, 
therefore, that the degree of implementation an ! acceptance of this technique was linked to both the 
outreach consultant's commitment and the school's willingness to provide programmatic support. 

Similar, although sightly weaker, relationships were found in examining the use and valuation 
of the School Site Councils in the program-planning process. There was a strong relationship (.50) 
between outreach consultants' commitment and their involvement in and evaluation of the School Site 
Council process. The greater the level of commitment, the more likely they were to both value and be 
more involved with the School Site Council. Support (.40) and influence (.43) also influenced opinion 
and participation. As administrative support increased, and the outreach consultant's influence in the 
school decision process grew, involvement with the School Site Council increased. 

Support by Principals - Orj»unL«itional Integration of SB 65 

In addition to examining factors impacting the outreach consultants, our research also explored 
the degree to which principals at the SB 65 sites support the program as a whole, and at the levels of 
commitment they perceive among others who are significant actors in the M&M program. Critical to 
program success are strong support and encouragement by the administrators responsible for overseeing 
SB 65 pilot s.nools. As in similar research elsewhere, our findings indicate that the level of integration 
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into the school culture of SB 65 components is strongly related to outcome.^ 

The school principal plays a critical role in providing administrative support and, by example, 
in establishing SB 65 as a viable, effective program. While "wishing doesn't necessarily make it so," 
support, communication flow, commitment, perceptions of program effectiveness, and articulated 
expectations concerning outcome are all measures of administrative support of the aims, goals, and intent 
of the SB 65 legislation. In examining the role of principals, the inescapable conclusion was that where 
SB 65 was viewed as part of a school-wide, coordinated effort to reduce dropouts, the program works; 
where the program was viewed as another source of categorical funding, however minimal, it does not. 
In the worst case, the program was simply ignored; the outreach consultant becoming an extra hand in 
taking care of paper work, collecting lunch money, or handling lights in the school gym. 

Principals' Assessment of SB 65 Proj^rani Components 

Eighty-five percent of all principals surveyed felt the Motivation and Maintenance program was 
'Very important" at their school site and was an effective means of preventing student dropouts. Although 
this percentage does not differ greatly across grade levels, elementary principals are slightly more likely 
to view SB 65 as important. Eighty-eight percent of the elementary principals see SB 65 as highly 
relevant to preventing dropouts, compared to 83.8 percent of middle school principals. High school 
principals show a slightly lower (80%) agreement with this assessment. Only five respondents saw the 
program as of "little or no value." 

Administrative assessment of generalized program importance, however, does not determine 
organiz:ational priorities. It is quite possible to be supportive of a program in the abstract, while ignoring 
program components in terms of resource allocation. In accepting the SB 65 grant, the schools agreed 
to develop a variety of program components including Student Study Teams, School Site Councils, and 
the new position of outreach consultant. In addition, SB 65 schools were supposed to implement school- 
based coordination of resources, develop community resources and partnerships, and ensure staff in- 
service training on techniques of working with high-risk youth. These constitute a fairly extensive list of 
program elements, and principals were asked to rate each component in terms of its effectiveness. 

Assessments of SB 65 program component effectiveness covered a full range of responses. In 
general, however, elementary principals were likely to rate more program elements as "very effective" 
than were middle or high school principals. 

Administrative Environment of SB 65 Principals 

Program success also requires strong support and encouragement by district administrators. In 
practical terms, this implies a measure of administrative autonomy, sufficient resources, and district 
commitment and cooperation. Principals were asked the degree to which these elements were available 
to them in their role as site administrator. 

While district-level commitment to the SB 65 program was viewed as relatively high, both 
generalized support levels and measures of specific support were substantially lower. About half of 
elementary (5 1 %) and three-fifths of iddle school (61 %) principals report a "high" level of district com- 
mitment. High school principals, who saw lower levels of support for SB 65 generally, also report lower 



^ See Educailon Policy Implenientatloti (1991), edited by Allan R. Odden, especially Learning from 
Experience: Lessons from Policy Implementation," by Milbrey Wallin McLaughlin. This is an older 
article discussing the degree to which implementation studies need to focus upon attitude and 
organizational culture. 
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Table III.l 



Percent of Principals Reporting 
High Levels on Measures of 
District Support for SB 65 Program 



levels of administrative 
commitment; only 34 percent rated 
district commitment as high. 

Adniinislnitive autonomy, 
latitude to adapt program design to 
local school conditions, is seen by 
many as another form of support. 
At the elementary school level , 
while principals generally feel that 
they have some autonomy in 
implementing the provisions of SB 
65, they are less likely to feel that 
they have been able to get needed 
resources for the program from the 
district administration. Slightly less 
than 29 percent feel that the district 
has provided their staff with enough i^bi^^^^^^^^^^^^^^^^^^^^^^^^^^^^bhmbhmh 
materials to do their job, and only 

18 percent feel there are sufficient resources. Over one-fifth (22%) report feeling "highly frustrated" over 
having "so few resources and so much to do." At the middle school level there appears to be less 
administrative autonomy, equally strong perceptions about limited resources, and an even higher 
frustration level; sentiments echoed, with only slight variation, by high school principals. 

Especially significant is the differential between levels of perceived district commitment and a 
measure of overall support. At elementary schools, there is a 16 point difference between administrative 
and overall support; among middle school principals, it increases to over 34 percentage points. At the 
high school level, principals perceive lower generalized support for SB 65, but they also report only about 
half of the district commitment reported by principals of lower grades. 

Table 111.2 
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Middle 


High 


Types of Support 


School 


School 


School 


DisUicl conimilniciu lo SB 65 


51.2% 


60.5% 


34.1% 


Adminislrallvc aulonomy 


42.9% 


21.6% 


35.0% 


Disirict encourages OCs lo 








work as a loam 


41.7% 


42.1% 


29.3% 


Generalized dislricl suppoil 


35.7% 


26.3% 


25.0% 


Dislricl encouraged participation 








in summer workshops 


32.9% 


35.1% 


29.7% 


SlaTrhave necessary malcriaB8.9% 


25.6% 


10.0% 




Fruslralion over resources 


21.7% 


30.8% 


30.0% 


Sufficient district funding 


18.1% 


23.7% 


30.8% 
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For Aspects of the SB 65 Program 

The school principal, as 
chief site administrator, also plays a 
critical role in providing leadership 
to integrate the SB 65 program into 
the school culture. This leadership 
is manifested in a number of ways, 
including support for the outreach 
consultant, clarity to both the 
consultant and the rest of the staff 
regarding expectations about the SB 

65 program, consultation, encour- 

agement of teachers and staff in 
trying new methods and techniques, 
and frequent contact with the outreach consultant. 

Principals generally felt themselves to be highly supportive of the outreach consultant and t!.«. SB 
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High 


Types of Suppon 


St!mo! 


School 


School 


At least weekly contact OC 


85.7% 


34.2% 


78.0% 


Suppoil of outreach consultanl 


77.4% 


63.2% 


55.0% 


Encouragement to try new methods 


63.1% 


71.8% 


62.5% 


Consultative decision-making 


58.3% 


48.7% 


50.0% 


Clear communication of SB 65 goals 


47.6% 


33.3% 


37.5% 


OCs encouraged attend SDE institute 


42.5% 


39.4% 


29.7% 


High clarity outreach consultant role 


33.3% 


39.5% 


25.0% 
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65 program. Support seems generally liiiiher in smaller, elementary school environments. Roughly four- 
fifths of all principals, however, report at least weekly contact with the outreach consultant. 

The pattern of higher support for the SB 65 M&M program at the elementary level repeats itself 
throughout the principals' survey. Over three-quarters (77%) of elementary school principals and slightly 
more than half (55%) of high school principals saw themselves as providing "very high" levels of support 
for their ouireach consultant. Almost 43 percent of elementary principals report urging their outreach 
consultants to attend the State Department's SB 65 Summer Institutes; at the high school level the 
proportion was one-quarter. 

Two other measures seem especially important in assessing the administrative environment in 
which the outreach consultant operates: the degree to which principals clearly communicated their goals 
and expe^-tations regarding the SB 65 program, and the level of clarity regarding the outreach consultant's 
role. While closely related in theory, at different school levels there is considerable divergence. 

At the elementary level, one-third of principals report a high degree of clarity about the outreach 
consultant's role and almost half report that as principal they have clearly communicated SB 65 program 
goals to the entire school staff. There is a strong correlation (.44) between these measures. 

At the middle school level, there appears to be more clarity about the outreach consultant's role, 
but slightly less communication with school staff about program goals. Principals who are clear, however, 
are more likely to report high levels of goal communication; the correlation (.68) is even stronger than 
at elementary schools. 

In high schools, while 38 percent of principals report high levels of communication regarding 
program goals and objectives, only 25 percent report high levels of clarity regarding the outreach 
consultant's role. There is also no statistically significant correlation (.06) between the factors. This 
would suggest a major problem at the high school level in integration of the outreach consultant into the 
school culture. 

integration of SB 65 Into the Scliool Environment 

As noted earlier '° two distinct patterns of outreach consultant acceptance into the school 
organization continue to exist. At one extreme, the outreach -consultant (and the SB 65 program) have 
become an integral part of the school culture. Teachers, administrators, and others who are clear about 
the outreach consultant's role and about the program agree with the program's purposes and methods, and 
provide reciprocal support. Questions about these matters consistently elicit strong positive responses. 

At the other extreme, negative responses to these measures indicate situations where the outreach 
consultant and the program have not been integrated into the school organization. At a minimum of five 
sites, for example, there was virtually open wacfare between the principal and various factions within the 
school staff The outreach consultant in these extreme cases was either allied with the "wrong" side, or 
ignored completely. In other cases, the program itself was seen as having little value, and the consultant 
was again generally ignored. 

If these measures are viewed collectively, it is possible to suggest the degree to which the 
program has become integrated into the overall school organization. Responses to this measure of 
integration seems to confirm the two patterns suggested earlier: schools score either very high or 



'° Dixon, •'O'^i'i'^l^t^s of Effectiveness in California's Dropout Prevention Programs" Paper presented 
AERA Meeting, Boston, 1990. 
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relatively low on tliesc measures. Most schools have integrated the SB 65 program relatively well into 
the school's organiz<ilional culture. Among elementary schools, 78 percent show a relatively high degree 
of integration of SB 65 goals and aims. As expected from earlier fmdings, middle school programs are 
less well integrated, with schools where SB 65 was well integrated totaling slightly less that 65 percent. 
Integration of SB 65 into high schools was still lower, with only 58 percent of principals reporting a high 
degree of program integration. 

Linka}»es Between Inteiiration and Proj^ram Emphasis 

As noted 
throughout, SB 65 's implementation 
is highly dependent upon the 
attitudes and priorities of the school 
principal. The degree to which the 
program has been incorporated or 
integrated into the school environ- 
ment is closely connected to 
perceptions of importance of the 
principal and the support of others 
as perceived by the principal. 
There is a strong relation (.65) 
between the principal's own opinion 
and the principal's perceptions of 
the view of others within the school 
organization. Where support levels, 
both personal and perceived, are 
high, various goals and objectives encouraged by the SB 65 program have been well integrated into the 
school environment. The relationship between levels of program integration and the principaPs view of 
staff perceptions is very high (.57); it is exceeded only by the relationship (.61) between integration levels 
and the principal's own view of the importance of the SB 65 program. 

Levels of integration, in turn, are linked to the likelihood that the school will emphasize the 
various programmatic components of SB 65, including the use of the SST process, school site planning, 
school-based coordination and establishment of an in-service training program regarding high-risk youth. 
In general, the greater the level of integration of the program into the culture of the local school, the 
greater the congruence among the attitudes, goals, and objectives of the SB 65 program, outreach 
consultants, teachers, other staff personnel, and the principal, the greater the likelihood that these major 
program components will be seen as effective, therefore will be emphasized. 

Oversight & Assistance: SB 65 Proj^mins & the Stale Department of Education 

The third institutional player in terms of promoting implementation is the California State 
Department of Education. Despite a growing questions about the effectiveness of administrative oversight 
within the implementation literature, schools which reported higher levels of contact with SB 65 related 
staff at the State Department of Education were significantly also more successful. While due in large 
part to the efforts of the consultant responsible for SB 65 programs, the State Department's role was 
extremely positive. Those schools which received oversight and technical support from the Schoo! 
Intervention's Unit were those v/hich implemented the program as designed, and hence were successful 
in reducing dropout rate or improving CAP scores. 

It should still be added that the amount of oversight and technical assistance supplied to SB 65 
programs by the State Department of Education has been highly variable: both historically and currently. 
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At the progranVs inception, thcire appeared to be little Departmental interest in shaping implementation 
guidelinesrensuring compliance with program requirements, or providing training and technical assistance. 
With increased interest in dropouts and programs for high-risk youth, this situation changed somewhat 
between 1989 and late 1990. Smce that time-and despite the continued activities of those SDE personnel 
most closely affiliated with the program-the Department's internal budget cuts, competing program 
priorities, and extensive reorganiziition have resulted in a net decline in program emphasis. 

Prior to the 1989-90 program year, the State Department of Education provided little leadership 
or guidance on what was expected of the districts in meeting program requirements, on how outreach 
consultants should be utilized, and on how program components might be implemented. Outreach 
consultants were not given specific Job descriptions, and districts were not told what kind of support they 
were expected to provide nor what kind of criteria would be used in evaluating program performance. 
The result, despite relative clarity in the legislation, was extreme variability in program implementation. 
The outreach consultants job, for example, ranged from duties modeled directly on the authoiizing statute 
to jobs of collecting hot dog money, serving as the principal's administrative assistant, and making sure 
the lights in the gym were turned off after the basketball game.'' 

By 1989, however, this situation had begun to change dramatically. With the hiring of a new 
manager of the (then) High Risk Unit, a slight expansion of the Unites staff including a former outreach 
consultant as program facilitator, clear and detailed descriptions of the functions that an SB 65 outreach 
consultant could (and could not) perform were disseniinated to the field. The portion of the High Risk 
Unit which monitored and provided technical assistance to the SB 65 schools was increased following 
heavy personnel cuts which had left only one incumbent staff person to handle the needs of a variety of 
programs and several hundred schools. 

Among otht:^r activities which the Department initiated during the 1988-90 period, were Summer 
Training Institutes and conferences which offered training for outreach consultants, principals, and other 
school personnel. Offered in both northern and southern California in 1989 and 1990, these conferences 
and institutes were attended by outreach consultants and (to a lesser extent) their principals and district 
administrators. The result, for the first time, was a discussion of the function of outreach consultants and 
the level of support they could expect to re-^eive from their districts. 

By 1992 the priority assigned to the SB 65 program by the Department v/as again uncertain. 
While perceptions regarding the level of departmental interest, clarity and support generally improves], 
recent departmental reorganizations, budget cuts, and the continual reassignment of personnel left both 
principals and outreach consultants unsure both of whom to contact and the nature of the Department's 
future role. In addition, the Department now provides promotional or planning materials on at least three 
other dropout initiatives: C-LERN, SB-1274 and ESS. At the field level, the relationship between these 
programs and SB 65 remains unclear, and has resulted in further confusion among principals about the 
Department's goals and priorities. 

Principals and outreach consultants were surveyed independently regarding levels of support and 
guidance they currently received from the State Department of Education. In addition, they were asked 
about contact and support in previous years and whether there had been improvement or decline in 
accessibility and guidance. Interestingly, there was relatively little difference overall in patterr^s of 
assessment among principals and outreach consultants; principals' reports of high levels of contact v/ith 
the State Department were echoed by similar statements from outreach consultants at their schools. 



ERIC 



" SRA Associates, Prclimimvy Report SB 65 Motivation <^ Maintainance Prog}wn, California State 
Department of Education (1989), page 12. 
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Principals' View of SDE's Role 



Principals viewed the Stale Table 111,3 
Department's role in oversiglit of 
SB 65 as one involving little eontacl 
and minimal guidance prior to 1988- 
89. Over two-thirds (68%) of 
principals reported very low levels 
of contact during the most recent 
year, and a roughly comparable 
proportion (65 %) fell that the 
Departmenl had provided little 
guidance in previous years. High 
schools reported the most contact, 
followed by elementary and middle 
schools. Perceptions regarding the 
usefulness of stale guidelines prior 
to 1988-89 followed similar 
patterns: high schools found the 
guidelines most useful, followed by 
elementary schools and, at some 
distance, by middle schools. 

The Department's interest 
and oversight of the SB 65 program do appear to be increasing sharply. Almost 60 percent of principals 
fell strongly that SDE's interest in the program was increasing; and not quite half (44%) felt strongly that 
departmental guidelines and assistance had improved during the past two years. 

Overall departmental support for the SB 65 program was seen^s high by only 16 percent of SB 
65 school principals; approximately 25 percent of the principals report "low" or "very low" levels of 
support. Unsurprisingly, perceptions of departmental interest and support are significantly related to the 
principal's assessment of the program's overall importance, the tendency to participate in SB 65 
conferences and Summer Institute training programs, and somewhat more weakly to support for the SB 
65 outreach consultant. Departmental involvement, by way of the linkage through assistance and oversight 
of program activities, appears to have significant impact on program outcome. The greater the level of 
perceived departmental interest and support, the greater the principal's support for the program (.24), 
training activities (.47), and the outreach consultant's activities (.20). in turn a high level of support from 
principals is related to program success. 

Outreach Consultant's View of SDE's Fole 

Outreach consultants report significantly higher levels of recent contact with State Department 
of Education personnel than reported by school principals. Consultants, however, were even more likely 
to see a lack of departmental guidance prior to 1989. Slightly less than half (48%) of outreach consultants 
reported moderate to high levels of contact during the current year. More than ivv'o-lhirds (69%), 
however, felt that the Department had provided little guidance in previous years. 

Elementary schools and high schools reported roughly the same level of contact. Middle school 
outreach consultants report significant frequency of coinmunication with the State Department. Outreach 
consultant perceptions regarding the usefulness of state guidelines prior to 1988-89 were similar to those, 
of the principals, and were quite negative. 



Percentage of Principals Reporting 
Higli Levels of Contact, Guidance 
and Support from the 
Stale Department of Education 



Types of Coniaci & Support 


Elementary 
School 


Middle 
School 


High 

School 


Fniqiicni coniaci wiih SDE ihis 
SDE ovcrsighl increasing 


year 12% 
58.5% 


5.3% 
54.3% 


10.5% 
61.5% 


Clear guidelines prior to 1989 
Beiicr guidelines since 1989 


12.0% 
45.6% 


8.4% 
38.3% 


13.5% 
44.7% 


SDE guidelines consistent 


14.35? 


14.3% 


12.1% 


High SDE Support of SB 65 


16.07^ 


10.8% 


20.5% 
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As with the case of 
principals » outreach consultants Mi 
the Department's interest and 
oversight of the SB 65 program 
were increasing sharply. 
Approximately 59 percent iell 
strongly that SDE's interest in the 
program was increasing; a similar 
proportion (58.5 %) felt strongly that 
departmental guidelines and 
assistance had improved during the 
past two years. 

Outreach consultants were 
not asked questions regarding 
perceptions of the Department's 
overall support for the SB 65 
program. Interestingly, however, the levels of contact between the school and departmental per<x)nnei 
appear related to several key factors, including whether the consultant was encouraged to atte.id the 
sunuiier training programs, the clarity of the outreach consultant's duties, self-perceived acceptance by 
teachers and administrators* and levels of district support. Levels of departmental contact appear linked 
to a number of factors which have significant impact on program outcome, as with the principals. 
Outreach consultants reporting higher levels of contact with the Department were significantly more likely 
to have been encouraged to attend the summer institutes (.38), have a greater sense that they were 
accepted by other teachers and administrators (.28) and have a greater amount of clarity about their 
position and responsibilities (.25). They are also more likely (.37) to perceive levels of district report as 
higher than those without such contact. 

Section IV: Conclusions 

This paper has attempted to explore connections between successful dropout prevention strategies 
and the decision to actually implement those strategies at the site level. Section II, by empirically 
establishing which techniques were successful, yielded in Section III to a examination of the differences 
between schools which implemented these techniques and those which did not. 

Section 11 established, in general, that change in the three-year cohort dropout rate was most 
closely associated with five factors: the congruence level between the outreach consultant's ideal program 
and the one which has actually been implemented; levels of district support for the program; the 
importance placed by the principal on the School Site Council planning process; stability of the school 
administrative structure; and overall commitment by the outreach consultant to the SB 65 program. In 
addition, successful schools showed had successfully integrated the outreach consultant into the school 
culture and showed high levels of congruence between the outreach consultant's view of effective program 
strategies and those which they have been allowed to implement. 

Section 111, attempted to examine the preconditionsof implementation by moving "backward" into 
the program context; analyzing the linkage between adoption or emphasis of SB 65 program elements and 
roles played by three major institutional actors. For outreach consultants, who usually served as program 
coordinators, perceived levels organizational commitment to the dropout program, support from teachers 
and others, and a perception of their own sense of personal influence and efficacy were key in the decision 
to adopt program strategies. There was also a great deal of inter-relation between perceptions of 
commitment and support and the congruence between the outreach consultants* own goals and objectives 
and those they were allowed to implement. ^ ^ 
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Frequent conlacl wiih SDE ihis year 


24.4% 
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21.3% 


SDE oversi*»lil increasing; 


57.7% 


58.4% 


62.0% 


Clear ^'uiddines prior lo 19S9 


18.7% 


9.7% 


6.8% 


BeUer jiuidelines since 1989 


59.0% 


58.4% 


57.8% 


SDE guidelines consislcni 


11.8% 


16.3% 


16.3% 



Among Principals, the decision to adopt program strategies v^as strongly linked to how well the 
dropout recovery effort was integrated into the schooPs organiziitional culture. Where high levels of 
integration existed, almost all aspects of the program were implemented. Program integration, in turn, 
was dependent upon the principals' perceptions of importance of the program and the dropout problem, 
the importance of the program to the school and levels of district support and interest. 

Perceptions of the role of the State Department of Education by both outreach consultants and 
Principals indicated that those implementing the reforms had greater contact with the SDE technical staff 
and were more likely to have received technical assistance. There was a significantly greater clarity 
regarding program guidelines, expectations and strategies among those school sites implementing the 
program than among those which did not. 

As noted earlier, our results are hardly surprising. Programs which operate in supportive 
environments are significantly more likely to be successful than those wiiich must overcome administrative 
hostility or indifference. SB 65 programs were no different. These results, however, are very 
preliminary and incomplete. As Odden, Natriello and others observe in a variety of contexts, there is 
still a need to integrate and expand our understanding of school processes as these affect or contribute 
efforts to increase school holding power. 

Our results, however, do suggest a strong impact of organizational factors on the decision to 
adopt specific innovations and reforms. More work is necessary; undone is a continued and deeper 
analysis of the impact and interaction of structural, attitudinal and behavioral characteristics on program 
implementation. From a policy perspective, this 'third stage' research agenda may have the greatest 
payoff. Whether 'top-down' or 'bottom-up' adoption of reform appears dependent upon organizational 
culture and institutional factors. While our understanding of these has increased greatly in the past 
decade, we are still far from being able to adequately define organiziitional "pre-conditions" for successful 
program implementation. Although increasingly able lo talk about what program elements are effective 
when implemented, we have yet to establish for the policy-maker what institutional or school cultural 
changes must precede (or parallel) a new program to insure its 'street -level' success. 
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